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ABSTR\CT 


Dl," 


This thesis is an assessment of technical reports as a method for measuring the 
perfonnance of the Naval Aviation Engmeermg Services Umt (NAESU). Six 
technical reports are used to address the primary question asked in this thesis: Do 
N.AESU technical reports provide tangible cost savmgs through improvements to the 
reliability and mamtamability of aircraft weapons systems. Useful maintenance data 
pertaining to the items of interest was extracted from the Naval Aviation Logistics 
Data Analysis (NALDA) system. Cost data was taken from the Aviation Supply 
Office (ASO) master files. Based on the author's analysis, the cost savings from 
improvements m reliabibty and maintainability can be determined for each technical 


report. 
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I. [NTRODUCTION 


A. BACKGROUND 


The Naval Aviation Engineering Service Unit (NAESU) provides Engineering and 
Technical Services (ETS) to both Navy and Marine aviation communities. Its mission is 

to provide advice, information, instruction, and training in the installation, 
operation, modification and maintenance of aircraft systems and equipment [Ref 1] 


These services are provided by qualified DOD military and civilian personnel and by 
employees of private sector companies. 

In 1992 and 1993, the 102nd and 103rd Congress conducted heanngs to discuss 
growing concerns over the performance of Federal Government agencies To this end, they 
passed Public Law 103-62, better known as the Government Performance and Results Acts 
of 1993 From Congressional hearings and committee meetings, they determined [Ref 2] 

• Federal managers are seriously disadvantaged in their efforts to improve program 
eflSciency and effectiveness, because of insufficient articulation of program goals 
and inadequate information on program performance, and 

• Congressional policy making, spending decisions and program oversight are 
seriously handicapped by insufficient attention to program performance and results. 

Based upon these findings, the act included provisions to: 

• Require each Federal agency to submit to the Office of Management and Budget 
(0MB), beginning in 1997, a five-year strategic plan for agency programs, to be 
updated at least every three years. 

• Direct the Federal Government to submit to Congress, starting in FY99, an annual 
performance plan as part of the Budget of the United States 


With this law as a benchmark. Department of the Navy has begun the task of 
determining measures of performance for each of its components. Taking the lead, the Naval 



Aviation Engineering Support Unit (NAESU) is currently sponsoring on-going research to 
deterrnine specific performance measures for their organization This thesis is a continuation 
of' research begun by the Defense Resources Management Institute and the Naval 
Postgraduate School in 1992 at the request of the Commanding Officer, Naval Aviation 
Engineering Service Unit. 

The author will utilize NAESU Technical Reports (NTR) as a means of measuring 
performance of NAESU. Specifically, it will examine reports generated by ETS 
representatives, also known as "techreps", to determine their correlation to cost savings 
brought about by specific improvements in the reliability and maintainability of aircraft 
weapons systems. 

Reliability and maintainability are but two of eleven factors addressed in logistics. 
Logistics accounts for all necessary considerations to assure effective and economical support 
of a system throughout its programmed life cycle. [Ref 3] Both reliability and maintainability 
criteria are specified during acquisition of the weapons system and as such are measurable 
attributes This thesis focuses on the cost savings associated with achieving improvements 
in reliability and maintainability. 

Weapons systems should be designed to be maintained without large investments of 
time, money or other resources (e g., personnel, materials, facilities, test equipment) and 
without adversely impacting the mission readiness of that system In determining support 
requirements, the frequency of maintenance due to systems failures becomes a significant 
parameter The frequency of maintenance for a given item is highly dependent on the 
reliability of that item In general, as the reliability increases, the frequency of maintenance 
will decrease and, conversely, the fi-equency of maintenance will increase as system reliability 
is degraded Reliability is a design characteristic which measures the failure rate, or length 
of time between maintenance actions. On the other hand, maintainability is an inherent design 
characteristic dealing with the ease, accuracy, safety, and economy in the performance of 
maintenance functions. 

Since NAESU techreps are located at various locations worldwide, they are in a 
unique position to report information which can be used to improve methods and eliminate 



of time between maintenance actions. On the other hand, maintainability is an inherent design 
characteristic dealing with the ease, accuracy, safety, and economy in the performance of 
maintenance functions. 

Since \AESU techreps are located at various locations worldwide, they are in a 
unique position to report information which can be used to improve methods and eliminate 
deficiencies which have life long effects on reliability and maintainability Techreps write 
about problems from the perspective of years of experience on aircraft weapons systems The 
information they document is submitted formally as NAESU Technical Repons (NTRs). 
These reports are important means of communication by which the Navy and contractors are 
informed of technical problems, and, quite often, provided with acceptable solutions, NTRs 
deal with subjects of interest or concern to other Fleet activities and commands and to system 
support and management activities such as the Commander, Naval Air Systems Command. 
From these reports, program managers determine if changes to maintenance procedures or 
modifications to aircraft weapons system components are warranted 

B. OBJECTIVES 


The objectives of this thesis are to: 

• Describe the process by which techreps provide inputs for improvements to 
maintenance procedures, and modifications to aircraft weapons systems 

• Examine the NAESU Technical Report Record and Retrieval System data base to 
extract detailed information on those NAESU technical reports which relate to 
aircraft weapon's systems and to identify problems associated with gathering 
meaningful information from the data base 

• Examine data bases available for extracting reliability and maintainability 
information concerning aircraft weapon's systems and to identify problems 
associated with gathering meaningful information from these data bases 

• Determine the cost savings from improvements in reliability and maintainability of 
a sampling of NAESU technical reports for aircraft weapons systems. 



• Refine the methodology for analyzing NAESU technical reports for determination 
of their contribution to cost savings in the Naval Aviation community, 

C. PRIMARY RESEARCH QUESTION 

Do NAESU Technical Reports provide tangible cost savings through improvements 
to the reliability and maintainability of aircraft weapon's systems? 

D. SCOPE, LIMITATIONS AND ASSUMPTIONS 

The research effort is focused on a sampling ofNAESU Technical Reports (NTRs) 
that affected various aircraft The reports and their related feedback responses were selected 
from a cross-reference listing of those published by NAESU in "Technotes", a monthly 
compilation of NTRs submitted to NAESU headquarters during the month The listing 
covers a period from 1973 to 1994, but is not all inclusive of the reports written during that 
period Appendix A is a list of 199 of over 2,200 NTRs that sparked the author's interest 
during his review of NTRs at headquarters. 

This thesis is limited to recommendations that were justified by NAESU 
Technical Reports and approved by both the Cognizant Field Activity (CFA) and Program 
Manager The author recognizes other sources of information from the Nava! Aviation 
.Maintenance Discrepancy Reporting Program (NAMDRP), such as the Hazardous Material 
Report (HMR). Engineering Investigation (El), Quality Deficiency Report (QDR), and 
Technical Publication Deficiency Report (TPDR) which also provide inputs for consideration 
to the change process 

•Assumptions made in this thesis are. 1) the problems reported by ETS representatives 
are being experienced Fleet-wide due to common deficiencies, 2) no other change action was 
implemented dunng the period of analysis for each NTR, and 3) consumable repair part costs 
are negligible. 
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LITERATI RE REVIEW 


An extensive literature review failed to locate previous research that assessed the 
correlation between external technical suppon and the overall reliability and maintainability 
of aircraft weapons systems. The literature review attempted to locate studies from private 
industrv as well as from government agencies, both without success The author used several 
references which formed the foundation for several theses in the area of the Component 
Improvement Program (CIP). From these, data research methodologies and modeling 
techniques were adapted for use in determining changes in reliability and maintainability and 
resultant cost savings. 

F. ORGANIZATION OF STUDY 

Chapter II provides background concerning the history of NAESU, the responsibilities 
of ETS, N.AESU Technical Report guidelines, a description of the Cognizant Field Activity 
Program, procedures for processing ETS Technical Reports, and measures of performance 
Chapter Ill details the data collection process Included in Chapter III is the process used 
to locate NTRs and their respective feedback reports as well as maintenance data. Chapter 
IV details the methodology used by the author to select candidates for study and to construct 
a life-cycle cost analysis model for conducting research. 

Chapter V presents the data collected from each NTR including specific background 
information and an analysis of related maintenance data relating to each NTR to determine 
its effect on the reliability and maintainability of the item, and a determination of its 
associated cost savings Chapter VT presents a summary, conclusions, and recommendations 
for future study. 




II. BACKGROUND 


The purpose of this chapter is to provide the reader with: 1) A brief history of 
N AESL to understand the evolution of its missions and roles; 2) Information about ETS and 
their specific responsibilities, 3) A detailed narrative describing the format of NAESU 
Technical Reports (NTR), 4) .A discussion of the Cognizant Field Activity (CFA) program 
to gain a perspective on the responsibility for reviewing, approving or disapproving 
recommendations provided in N'TRs; and 5) The procedures for processing \TRs. 

A. A BRIEF HISTORY OF NAESU 

Dunng World War IT there emerged a demand for the installation of aircraft search 
radar, radar altimeters and new electronic devices. As the installations were completed. Naval 
Aviation was forced into an expanded and challenging era of increasingly technical 
maintenance In response to that challenge a pool of highly trained military radar specialists 
whose services were available upon demand was established Their mission was to assist in 
the installation, operation and maintenance of this complicated new equipment. The 
specialists were available for tours of temporary duty for two to four months during which 
time they would indoctrinate and provide on-the-job training to Navy and Marine Corps 
personnel Between assignments, they returned to home base for refresher courses and 
training in the latest equipment modifications. This pool of specialists led to the establishment 
of a new organization, the Airborne Coordinating Group (ACG) located at the Naval 
Research Laboratory in Washington, D C 

It was determined that the demand for qualified Navy technicians critically exceeded 
the axailabiliiy of those within the nucleus of military persormel, so aerospace manufacturers 
supplied field technicians to work with the Navy technicians. In January, 1943, approximately 
thirty civilian contractor technicians and a few Navy technicians comprised the ACG By 



1944. the demand for service led to an increase of 200 civilian contractor technicians and 60 
Navy technicians By that time they had completed more than 1,500 tours of duty. 

The ACC's establishment and continued existence was further solidified as evidenced 
by an increase of personnel by post war time frame to include the participation of Civil 
Service Personnel In 1948, the ACG was renamed the Naval Aviation Electronics Service 
Unit, with an expanded mission to support ail types of aviation systems and equipment The 
expansion was based on the deterioration of general readiness conditions of electronics 
equipment and growing shortage of technical personnel Consequently, these technicians 
found themselves gradually shifting fi-om specialists on specific types of equipment to general 
tecitnicians on any and all types of aviation systems and equipment. Training policy changes 
gave the technicians increased involvement with all types of equipment 

In January, 1959, the Secretary of the Navy directed that the organization's name 
again be changed to the Naval Aviation Engineering Service Unit (NAESU) and reaffirmed 
the mission to provide field engineering assistance and instruction to Naval Aviation activities 
in the installation, maintenance, repair and operation of all types of aviation systems and 
equipment Within the scope of the administration of Engineering Technical Services 
(ETS) was the procurement of technical services from aerospace manufacturers in the form 
of Contractor Engineering Technical Services (GETS). These personnel were also located 
on site at each of the Naval Air Stations As technology developed and became more 
sophisticated. Naval Air Stations located throughout the world realized the critical need to 
have continued on site support by the NAESU technician. To handle an expanding work 
force resulting from its extensive demand for technical support, NAESU was administering 
492 field technicians. 

By 1962. two field detachments: NAESU Detachment ONE, located at the Naval Air 
Station, North Island. California; and NAESU Detachment TWO, located at Naval Air 
Station, Norfolk. Virginia, were providing regional support for NAESU Headquarters located 
at the Philadelphia Naval Base Gradually, NAESU detachment offices were established 
across the United States and beyond to both Europe and Asia. As the progress of detachment 
establishment evolved, the technical and administrative responsibilities of NAESU 



Detachments ONE and TWO increased and they became the regional area of authority 
enhancing the focus on detachment offices located on the West Coast and in Asia, and on the 
East Coast and in Europe, respectively Eventually, the Southern Regional Office was 
established in New Orleans, Louisiana, as the focal point for all Reserve Aviation activities. 
N.AESU detachment offices currently number more than 40 worldwide. In 1966, Naval Air 
Systems Command (N.AVAIR) established NAESU as the major supplier and administrator 
of ETS. for Aviation Maintenance Suppon 

B. ENGINEERING TECHNICAL SERVICES 

Engineering Technical Services consists of information, instruction and training 
provided to DOD personnel ashore and afloat in the installation, operation and maintenance 
of aircraft weapons systems and related support equipment. ETS are interim instructional 
services tailored to a specific requirement Colon [Ref 4] concluded ETS meets the criteria 
as a logistics element. As a logistics element for naval aviation, NAESU ETS are required 
to [Ref 5] 

• Accomplish the initial transfer of knowledge from equipment manufacturer to 
organic Navy during equipment introduction to fleet units. 

• Provide on-the-job training and assistance to untrained personnel. 

• Enhance the classroom experience of newly trained maintenance technicians by 
elevating their technical skills to required levels 

• Provide assistance for resolution of unusual or difficult maintenance problems 

• Maintain technical information channels and liaison between the manufacturer and 
the Navy. 

ETS will be used primarily to complement FRAMP, MTEP, and shore based 
turnaround training. They are not intended to be a corrective measure for inadequate 
integrated logistics support (ILS) planning, funding or execution. Use of ETS aboard ship 
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durinu routine aircraft carrier or carrier air wing work-up training periods and short-term 
assists is an ,\ircraft Controlling Custodian (ACC)/Type Commander (TYCOM) management 
option Normally ETS will not be embarked for extended deployment In those instances 
where actual, unavoidable logistic, personnel or training deficiencies exist, ACCs/TYCOMs 
mav continue to deploy ETS on a limited basis. Such support will be restricted to fact-of-life 
cases where that option is the most logical, cost-effective alternative Use will be closely 
monitored and limited to an absolute and justifiable minimum ETS will not be used to: 
[Ref5] 


• Perform maintenance or inspections of any type. 

• Install engineering changes 

• Obtain replacement parts and material 

• .Arrange for shipment of defective components. 

• Avoid manpower ceilings or other personnel rules and regulations of the Office of 
Personnel Management, DOD and the Department of the Navy 

Initial ETS requirements will be Included in appropriate integrated logistics support 
(ILS) and phased suppon plans. From these, long term programmatic ETS support plans will 
be developed by NAESU in conjunction with individual fleet customers, ACCs/TYCOMs, 
and the N.AVAJR Assistant Program Manager for Logistics (APML). These plans will 
document requirements by site or billet and wiU be used to justify budget requests and allocate 
available resources. [Ref 5] 

Engineering Technical Services are performed by NETS, who are organic Navy 
personnel (military and civilian) and by contractor ETS (CETS) who are commercial or 
industrial contractor personnel. [Ref 6] As shown in Figure 2.1, NETS are further divided 
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inio >'a\v Militan' Technical Specialists (NMTS) and Nav>' Civilian Technical Specialists 
(NCTS). NMTS are made up of active duty and reserve military personnel These sailors 


DOD(NETS) CONTRACTOR ETS (CETS) 

- Civil Service (NCTS) - Contractor Field Support (CFS) 

- Military (NMTS) 

- Competitive (CFSC) 

- Prime (CFSP) 

- Contractor Plant Services (CPS) 


Figure 2.1, Engineering Technical Services 


possess in-depth knowledge of a particular weapons system or component and act as subject 
matter experts who fill the role and duties of an ETS member NCTS are civilian employees 
who work for the military as civil servants. They are managed by the Navy and fall under the 
General Schedule (GS) rating system. They, too, are technical specialists with special 
qualifications which allow them to provide information, instruction and training. In general, 
the duties and responsibilities of N'ETS personnel fall into the following categories: 

• Furnishing on-the-job training and classroom instruction to Navy and Marine 
Corps personnel in the installation, operation, maintenance and repair of aviation 
systems and equipment 

• Detecting technical deficiencies in the maintenance and operation of aviation 
■wstems and equipment and determining methods by which those deficiencies can 
be eliminated 

• Investigating failures of equipment and demonstrating to military and civil service 
personnel the means and methods for overcom.ing failures 





• Assisting in the installation of aircraft maintenance equipment, shipboard and 
ashore, and providing on-the-job training to appropriate military and civil service 
personnel 

• Solving specific maintenance problems and providing technical information to 
naval and other DOD activities 

• Submitting technical reports as required. 

•As is also shown in Figure 2 1, GETS are funher divided into Contractor Field Service 
(CFS) and Contractor Plant Services (CPS). CFS are provided to user activities on site at 
designated military locations by prime contractors (CFSP) or through competitive 
procurement (CFSC) CFS's function as follows; 


CFS personnel provide technical information, liaison as required, and formal, 
structured, and on-the-job training. They possess specialized knowledge, 
experience, and skills and have access to information covering the installation, 
operation, modification, and maintenance of DOD weapons, equipment and 
systems. [Ref 1] 

CPS are provided to user activities at the contractor's plant or at another designated facility, 
and provide: 

training courses, training aid programs, system/component knowledge, and 
other essential skills relating to the development of the technical skills 
required for installing, maintaining and operating such equipment [Ref 1] 


Both types of GETS may be continued after introduction to fleet activities Normally the use 
of GETS will not exceed 12 months after Navy Support Date (NSD) Exceptions to this 
limitation may be approved on an individual basis by NAESU as delegated by the 
Commander, Naval Air Systems Command in the event logistic deficiencies jeopardize 
achieving mission goals. Exceptions may not exceed 12 months 



c. 


NAESl TECHNICAL REPORT GUmELINES 


A primary source of infoimation which can be used to improve methods and eliminate 
deficiencies in the area of aviation maintenance is the NAESU Technical Report (NTR), This 
repon is an important means of communication by which the Navy and contractors are 
informed of technical problems and, quite often, provided with acceptable solutions. 
Frequently, the people who read the report and are required to take action on its content have 
never seen the equipment. This makes it paramount for the reports to be clear and concise. 
The importance of these reports should never be underestimated as they are an integral part 
of the duties and responsibilities of NETS/CETS personnel. Specific criteria and format for 
submission of NTRs are provided in References 7 and 8. 

Submission of reports is typically left up to the individual ETS representative, 
although at times, a Fleet command may request them to submit a report relating to a specific 
deficiency discovered at their command. Figures 2.2 and 2.3 depict the mix of NTRs 
submitted by each detachment and by each program for 1994 Some of the subject areas 
suitable for reporting are: 

• Conditions which present a hazard to personnel or equipment. 

• Safety of flight conditions 

• Frequent occurrence of the same or similar problems which indicate that a defect, 
incompatibility or deficiency exists in a technical or logistical area. 

• Technical problems whose solutions are beyond the capability of the local activity. 

• Discrepancies found in new installations or authorized changes to an equipment or 
system. 

• Modifications developed in the field to improve equipment performance or 
maintainability. 

• Recommendations for new or improved operating procedures. 

• Evaluation of equipment, handbooks and procedures 
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• Evidence of improper quality control in maintenance, rework or manufacture of 
components and/or pans and improper handling, packaging or shipping. 







D. COGNIZANT FIELD ACTIVITY PROGRAM 

Cognizant Field Activities (CFA) are those activities which have been assigned the 
responsibility and delegated the authority by Naval Air Systems Command Headquarters to 
perform all or portions of the in-service functions consisting of the totality of logistics 
management and basic design engineering, including procurement support, which are required 
to be performed for a service equipment in order that it may continue to operate properly and 
perform useful functions throughout its service life [Ref 9] Designation of the prospective 
CFA will be accomplished as early as possible in the life cycle of the equipment but not later 
than equipment introduction to the fleet Service equipment included in the CFA program 





includes those aircraft, target, drone, and other airborne shipboard, and shore based systems 
and their included supporting subsystems, equipment, components, software, and related 
suppon equipment, including related test program sets 

Frequently, Naval Aviation Depots (NADEP) are assigned as CFAs for service 
equipment, as is the case for all of the equipment reported in the NTRs selected for analysis 
in this thesis Depot (D-) level industrial functions consist of three general categories 

• Those involved in the rework of existing aviation end items, systems, components, 
and support equipment This includes maintenance and modification functions, 

• Those involved in the manufacture of items and component parts otherwise not 
available 

• Those involved in support services functions which include professional 
engineering, technology, and calibration services 

The third category relates to those functions performed while acting as the CFA. 
These functions encompass all efforts for the assigned service equipment to: 1) support and 
maintain the intended mission capability, 2) maintain inherent design capabilities of the service 
equipment at the minimum expenditure of resources; 3) preserve the planned operational life; 
and 4) achieve readiness goals This effort is accomplished through application of design, 
maintenance and logistic principles. 

The CFA program most directly affected by NTRs is In-Service/Reliability Centered 
Maintenance (ISE/RCM) This program consists of a number of functions which gather 
information which in turn define evolving technical requirements relating to specific 
aircraft/systems/equipment. These functions encompass all efforts: [Ref 5] 

• To support and maintain the intended mission capability 

• To maintain inherent design capabilities of the systems/equipment/aircraft at the 
minimum expenditure of resources 



• To preserve the planned operational life 

• To achieve readiness goals 


L PROCESSING NAESU TECHNICAL REPORTS 


It is the policy of the Commander. Naval Air Systems Command to maintain aircraft 
and their related equipment and material so as to ensure maximum readiness at all times 
.NETS are in a position to develop and report information which can be used to improve 
methods and eliminate deficiencies in equipment [Ref 9], It is incumbent upon CFAs to 
utilize this valuable information To this end, NAVAIR: 1) emphasizes the need for prompt 
disclosure of vital information provided by NETS personnel; 2) establishes a channel for the 
collection of data from .NETS, and 3) establishes effeaive follow-up action in order to realize 
tangible benefits. 

L'pon receipt the CFA must review all NTRs and take steps to correct disclosed 
discrepancies or items requiring expeditious actions The CFA is directed to provide the 
originator of the NTR and NAESU Headquarters the proposed or final disposition on the 
report within 60 days The CFA has sole authority for communications with contractors or 
other activities regarding these reports. NTRs not only report the problem, describe the 
equipment, and give detailed analysis, they often provide tested solutions to the problem 
Solutions to problems take many forms, but most often they are changes to maintenance 
procedures published in technical manuals. Figure 2 4 is a listing of CFA action codes, with 
the associated number of actions taken on the NTRs reviewed by the author. 
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Action Code: 

Number 
of Actions 

(0) - Submitted to CFA. 

"I 

(1) - Affirmative action completed. 

1 

(2) - No action required (misc. info published in Technotes). 

0 

(3) - Negative action completed FTTR recommendation rejected. 

46 

(4) - Negative action recommended by other than CFA. 

0 

(5) - Recommended by CFA. action dependent on another activity. 


(6) - Recommended by CFA, action scheduled for completion. 

0 

(7) - Review by other than CFA initiated. 

0 

(8) - Referred by CFA to another activity. 

0 

(9) - Review initiated by CFA. 

0 

(lO)-Review Pending 

6 

(A) - Publication Change 

14 

(B) - Maintenance Procedure/Publication Change 

54 

(C) - Equipment Modification/Specification/Pub. Change 

15 

(D) - Equipment Defect 

9 

(E) - Maintenance Level Change 

1 

(F) - RAMEC 

2 

(G) - Test Program/Software Change 

17 

(H) - Equipment Test Procedure Change 

4 

(!) - Material Deficiency 

3 

(J) - Change to Technical Directive 

1 

(K) - Beneficial Suggestion 

0 

(L) - Storage Procedures 

1 

(M) - Supply Assist 

6 


Figure 2 4 CFA Technical Report Action Codes 


F, MEASURES OF PERFORMANCE 

As mentioned in Chapter I, the major focus of this thesis is to determine a measure 
of performance for NAESU. Boynton [Ref 10] determined performance measures of techrep 
organizations encompass a wide variety of areas which add value to the Department of 
Defense (DOD) An example cited was the ability of techreps to determine a procedure to 





repair an item locally that would otherwise have required depot repair. Significant savings 
were realized as a result of techreps intervening so as to avoid depot or contract repair costs. 
Techreps, through their years of experience, are aware of equipment that could possibly be 
repaired at lower levels of maintenance with potentially significant savings to the government. 
.Although most references appear to focus on training as the primary responsibility of the 
techrep. other activities provide a tremendous contribution to the aviation maintenance 
community. As Boynton [Ref 10] further states 

Performance measures developed for techrep organizations must take 

cognizance of these seemingly peripheral activities. 

Reliability and maintainability can be used as performance measures because they are 
each tangible attributes of any piece of equipment in the Navy's inventory. Reliability is 
defined as the probability that a system or product will perform in a satisfactory manner for 
a given period of time when used under specified operating conditions [Ref 3] Reliability 
is the underlying factor in determining the failure rate of the weapons system. Maintainability, 
on the other hand, is defined as the ease, accuracy, safety and economy in the performance 
of maintenance actions [Ref 3] Systems should be designed to be maintained without large 
investments of time, money or other resources (e g , personnel, materials, facilities, test 
equipment) and without adversely impacting the mission readiness of that system Again, the 
time element can provide a measure of system performance. Maintainability is a characteristic 
designed into an item which can be defined through the level of maintenance performing 
repair actions, maintenance frequency, maintenance times (i.e , elapsed times and labor- 
hours). and maintenance cost. 
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aj. DATA COLLECTION PROCESSING 


A. NAESL TECHNICAL REPORTS AND RELATED FEEDBACK 

Initially, the author's focus was on those NAESU Technical Reports (NTR) which 
resulted in Engineering Change Proposals (ECP) on the related system. ECPs are proposal 
documents which direct and provide instructions for the accomplishment of changes, 
modifications, repositioning, or alteration of material in-service aircraft, weapon systems, 
assemblies, subassemblies, components, or support equipment. [Ref 6] The author visited 
with the Officer-in-Charge ofNAESIJ Detachment, Naval Air Station, Lemoore, C.A, CW04 
.Adams [Ref 11], to establish the baseline for future research relating to NTRs. He provided 
copies of all references applicable to the ETS, and copies of recently published "Technotes", 
a publication printed monthly by NAESU headquarters, which contained several NTRs 
written by techreps in his detachment. 

The techreps at NAESU Detachment, Lemoore, provide ETS for the Navy's west 
coast F/.A-18 community As one of the newest and most technically complex aircraft in the 
Navy's inventory, one would expect there would be numerous NTRs available for study at this 
site alone Unfortunately, this was not to be the case. Numerous NTRs had been submitted, 
yet, records of feedback reports, in particular, those with actions resulting in ECPs, were not 
available An interview with Mr Tom Ford [Ref 12], the ETS supervisor, revealed most 
feedback was received through telephone conversations between techreps and their 
Cognizant Field Activity (CFA) counterparts. If the discrepancies discovered significantly 
affect aircraft maintenance, CFAs take immediate action to resolve the discrepancy and rarely 
provide formal feedback reports. 

The author contacted the Commanding Officer of NAESU, CDR Van Sickle, to 
request permission to use his staff for thesis research [Ref 13]. He approved the request and 
Mr Ron Rush. Program/Management .Analysis Officer was tasked to assist the author in 




obtaining copies of the F/A-18 aircraft NTRs and feedback repons from which CFA ECPs 
were initiated Repons received were forwarded to the author, but upon review, none had 
resulted in ECPs. 

The author visited NAESU headquaners to conduct funher research using the 
N,\£SL Technical Repon Record and Retrieval System data base, and was put in contact 
with Mr Al Tentilucci, Supen/isory Management Analyst, and Ms. Rita Acquarolo, 
Management Analyst. When interviewed about this data base [Refs. 14 and 15] they 
informed the author the system had only been implemented in 1993, and was simply a data 
base program constructed by a staff member The author was informed this staff member had 
been out of the office for medical reasons since November 1994, so not be available for an 
interview 

Upon review of the data base, the author discovered the available data was insufficient 
for study, so decided to review as many copies of "Technotes" as possible in the constrained 
time of the visit Ms. Acquarolo provided the author copies of the master index of NTRs 
which covered all published reports from 1973 to 1994. The master indices were formatted 
by author's name and by system nomenclature, which was most useful in determining who 
wrote each NTR, and when each was written and published Unfortunately, there was no 
reference to CFA feedback reports in the indices Appendix B shows the format used by 
N.AESU to index NTRs The author reviewed all NTRs published between 1981 and present. 
As It were, all were intact, but the only years CFA feedback reports had been included were 
from 1986 to 1988. 

The author consulted with Mr Tentilucci and determined the best course of action 
was to limit the scope of study to a specific period and to divert the focus from NTRs relating 
to ECPs to those that possibly contributed to improved reliability and maintainability of an 
aircraft weapons system To this end. NAESU requested all detachments provide copies of 
all NTRs and their respective CFA feedback reports for the period from 1986 to 1988 



MAINTENANCE DATA SOURCES 


There are numerous data bases available for use that collect maintenance related 
statistics. Jones [Ref 16] listed over 19 data bases of interest in his efforts to determine the 
benefits of the Component Improvement Program (CLP) to the J-52 engine. Most beneficial 
to his research was the Naval Aviation Logistics Data Analysis (NALDA) data base, which 
this author chose as his primary source of maintenance related data. This data base is derived 
from maintenance documentation completed at both Organizational (0-) and Intermediate 
(I-) level maintenance activities. 

C. LABOR RATES FOR "O ” AND "1" LEVEL MAINTENANCE 

Labor costs at an hourly rate for O- and I-levels of maintenance were acquired from 
the Visibility and Management of Operating Support Cost (VAMOSC) data base. [Ref 17] 
The labor rates acquired were for the years 1979 up to and including 1993 The labor rates 
for 1994 and beyond were estimated using a 6.1% estimate which was the average over the 
last four years This method was also used by Jones [Ref 16] and Murphy [Ref 18]. 

D. MATERUL/DEPOT REPAIR COSTS 

Material costs were determined through use of the Navy's FEDLOG program 
FEDLOG is an interactive CD-ROM based data retrieval system which contains pertinent 
supply data including part numbers, federal stock numbers, unit of issue, unit price, net price, 
and more. Depot repair costs were determined through use of the Aviation Supply Office 
(ASO) master files One module of this, called "Snapshot", includes the current repair cost 
for each repairable item In addition, the author contacted item managers to validate the 
master file data Item managers are responsible for determining stock requirements for 
specific items that are used in support of all naval activities. 


23 




IV. METHODOLOGY 


A. ( HOOSING CANDIDATES FOR STUDY 


,As mentioned in Chapter ttl, the author chose to focus on N'TRs published during the 
period between 1986 and 1988 because these NTRs and their related feedback repops had 
been published in N.AESU Technotes on a regular basis After the second data call by 
N AESC Headquaners. the author obtained several other NTRs and their respective feedback 
reports, some of which will be used in this thesis for analysis In total, the author collected 
199 NTRs for review Figure 4 I relates the breakdown of these by NAESU 
program. 



Upon review, the author discovered actions taken on NTRs by CF.As were quite 
varied, ranging from no action to major equipment modification. Figure 2.4 relates the 
number and tvpe of action taken for the NTRs reviewed As can be seen, over one-third 




resulted in maintenance procedure/publication changes. It was this type of CFA action that 
determined the criteria for selection of sample NTRs, From over fifty NTRs meeting this 
criteria, the author chose at random six for in-depth analysis to determine if they provided 
tangible cost savings through improvements to the reliability and maintainability of aircraft 
weapons systems. 

B. COLLECTING MAINTENANCE DATA 

The author visited ENS Rebecca Kirk, Quality Assurance Officer, Aircraft 
Intermediate Maintenance Department (AIMD), Naval Air Station, Lemoore, CA, to collect 
information from the NALDA system. The author was interested in obtaining condensed, 
user friendly information relating to maintenance actions on the components discussed in the 
NTRs being analyzed ENS Kirk directed the author to AZl Gilman, AJMD Data Analyst, 
who produced several Equipment Condition Analysis (ECA) reports for the author from the 
N.ALD.A system. 

ECA reports offer excellent insight down to the component level of all maintenance 
actions performed during the periods of interest for each item being analyzed The author 
searched specific reports to segregate maintenance actions by month, to establish a trend of 
reliability/maintainability information specifically related to the item of interest. 

1. ECA Report Number 0500 

Known as the Period Monitoring Program Report, ECA "0500" (see Figure 4 2) is 
a highly flexible analytical tool The report produces trend analysis data on a period-by- 
penod basis covering a twelve period span A description of the column headings follows 

• "SUBTOTAL ELEMENTS" - This column identifies the WUC of the item of 
interest for the trend analysis being conducted 
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• "PERIOD'' - Lists twelve periods as defined by the analyst for use in producing 
trend analysis data 

• "Total" - This is a summation of the numeric data provided in the twelve penod 
columns 

2. EGA Report Number 0530 


Known as the Detailed Maintenance Action Record Report, the EGA "0530" (see 
Figure 4 3) is a detailed description of the results of particular maintenance action This 
description includes qualitative and quantitative data elements. A description of the column 
headings is provided below Examples of specific codes are shown in Figure 4 4. 

• "TYPE EQPT GODE" - Type Equipment Gode (TEC). A TEC is assigned to 
every type, model and series aircraft, to every engine configuration and type of 
support equipment The SH-3H aircraft, for instance, has a TEC of AHCM 

• "BUREAU SERIAL NUMBER" (BUNO) - The BUNO is used to identify 
individual airframes within the naval aircraft inventory. Each number is unique to 
a particular airframe 

• "WORK UNIT CODE" (WUC) - The WUC identifies the system, subsystem, and 
component or part of an aircraft, engine, or item of support equipment. 

• “PI" - Position Indicator Identifies the position of the installed engine, port or 
starboard. 

• "Part Number" - A number used to identify an item of production or a range of 
items of production, by the manufacturer controlling the design, characteristics, 
and production of the item. 

• "MFG CODE" - Manufacturers Code A number assigned to manufacturers of 
items procured by agencies of the federal government 
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• "SERIAL NT3R" - Serial Number A unique number assigned to each part 
numbered repairable system, subsystem, and component or part of an aircraft, 
engine, or item of support equipment "JCN" - Job Control Number. A unique 
number consisting of the Organization Code (ORG), Julian Date (DATE), 
Sequence Number (SEQ) and suffix (SUE). The ORG code is a structured code 
that identifies activities within a major command. The Julian Date is the date the 
mamtenance action originated The SEQ code is a code that is assigned at the time 
the maintenance action originated The SUF code is a code that identifies the 
maintenance action of a subsystem, component, or part to the original maintenance 
action on system 

• "MC" - Meter Code Identifies the baseline time standard the component uses to 
accumulate operating time. Examples are "A" for aircraft time, and "M" for meter 


• "METER TIME" - Identifies the number of operating hours since new 

• "TM" - Type Maintenance code. This is a code that identifies the type of 
maintenance performed 

• "WD" - When Discovered code. A code that identifies when the maintenance 
discrepancy was discovered. 

• "ML" - Maintenance Level code. Maintenance tasks are divided into three levels 
so common standards can be applied to the many and varied aircraft maintenance 
activities of the military The three levels are depot (D-), intermediate (I-), and 
organizational (0-). 

• "ACT ORG" - Action Organization code. This is the same as the ORG code, but 
identifies which activity performed the last maintenance action for a specific JCN. 

• ".ACT DATE" - Action Date This is the Julian date at which the maintenance 
action is completed 

• "AT" - Action Taken code. A code that describes what action has been 
accomplished on the item identified by a WUC. 

• "MAE CODE" - Malfunction Code. A code used to describe the malftinction 
occurring on or in an item identified by a WUC 
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• ' EVIT OR DAY" - Elapsed Maintenance Time or Day Identifies the length of 
time maintenance was being performed on the item identified by a WUC. This 
time is not cumulative for more than one person working on the item at the same 
timeTMAINT MAN-HOURS" - Maintenance Man-Hours. This is the cumulative 
length of time maintenance was being performed on the item identified by a WUC 
It includes the time all personnel are working on the same item 

• "CT OY RP RE" - Corrosion Type For future use Undefined for the current 
version of N.ALDA. 

• "ICC" - Incoming Condition Correction Code For future use Undefined for the 
current version of NALDA. 

• "DRCT MATE COST" - Direct Material Cost. For future use Undefined for the 
current version of NALDA. 

• “CC" - Card Code For future use Undefined for the current version of NALDA 







t. 


RESEARCH MODEL 


The author chose a period of time ranging from one year prior to and one year after 
the NTR was written Data fields from ECA reports which were of particular interest for 
analysis are listed below, 

• Work Unit Code. Used to sort the data of interest from the NALDA system to a 
particular aircraft and system 

• Part Number: Used to further segregate the maintenance data because the Work 
Unit Code may apply to several other part numbered items as well 

• Maintenance Level: Used to further differentiate between those maintenance 
actions performed at the Organizational (0-) and Intermediate (I-) levels of 
maintenance, 

• Action Taken Code: Used to determine valid failures, excluding those 
maintenance actions that are administrative in nature or were not a type of repair 
action, 

• Malfunction Description Code: Also used to exclude those maintenance actions 
that are administrative in nature or were not a type of repair action as well 

• Maintenance Man-Hours: Used to quantify the time spent on specific maintenance 
actions. 

The author requested "0500’’ repons with specific parameters to establish a trend 
during the period of interest for which each item addressed in the NTRs was analyzed 
Parameters included verified fails, O-level manhours, and I-level manhours over 12-month 
time periods The purpose behind use of verified fails to attempt to establish a trend of true 
failures associated with each item. Any indication of reduced numbers of failures would 
signal a direct benefit from the NTR on the reliability of the item. More simply stated, the 
fewer failures over a specific period correlates to fewer maintenance actions which defines 
the term reliability. 
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Additionally, the author was interested in the number of maintenance manhours at 
both 0-level and I-level maintenance activities associated with corrective maintenance on a 
failed item Any indication of reduced numbers of manhours expended per failed item would 
signal a direct benefit from the NTR on the maintainability of the item Again, more simply 
stated, the fewer manhours required to repair failed items correlates to less time spent in 
direct maintenance activities. Overall, this defines the term maintainability From the number 
of failures and maintenance manhours, and 0-level and I-level wage rates [Ref ], the author 
could determme the average 0-level and I-level maintenance manhour per failure, total labor 
costs for each period of time, and could forecast the future labor costs of maintaining the 
item. Using this information, the author would be able to conclude if there indeed was a cost 
savings realized through improved reliability and maintainability 

The next step was to determine material/depot repair costs for equipment failures 
First of all, the author assumed the costs for bit and piece repair materials used in I-level 
repair was negligible, so they were not included in the model for study. The author requested 
"0530" reports with specific parameters to analyze each maintenance action performed on 
the items of interest Parameters included type aircraft, WUC, and period of interest The 
purpose behind this was to determine the number of items that were not being repaired but 
were being returned to the D-level for repair because it was beyond the capability of 
maintenance (BCM) at O- and I-level maintenance activities. This could be determined by 
counting the number of maintenance actions with a numeric "Action Taken" code (see Figure 
4 4) .Any indication of reduced BCM actions would signal a direct benefit from the NTR on 
the maintainability of the item From this, the author could determine the average number of 
BCMs. and, using current depot repair cost data, could forecast the future costs of 
maintaining the item from a material cost viewpoint Using this information, the author could 
evaluate cost savings realized through improved maintainability 

After collecting data from all relevant sources, the author constructed a spreadsheet 
for each NTR of interest Chapter V presents these spreadsheets as well as a discussion of 



each NTR and its related feedback report Aiso included is a graphic representation of the 
trends of the maintenance data from a period one year prior to the NTR to one year after 
Finally, the author presents an analysis of each 




V. NAESU TECHNICAL REPORT ANALYSIS 


A. NTR SERIAL NUMBER 9388/02 

20 April 1994 
Christopher Pinkava 

NAESU Detachment Barbers Point, Hawaii 
The AN/ARN-140 Navigation Receiver is a VOR, localizer glideslope 
and marker beacon receiver used by P-3C aircraft to provide VOR bearing, course deviation, 
to-from, glideslope deviation, and marker beacon lamp information to allow enroute air 
navigation and instrument landing. At the time of this report, there were no Ready-For-Issue 
(RFI) AiN ''ARN-l40 receivers available in the supply system. The previous method of depot 
repair by a civilian contractor was not efficient and caused depletion of these much needed 
fleet assets. This report addressed this shortage and proposed a cost effective modification 
to an obsolete test bench that would establish in-house maintenance capability for the Navy 
at the Intermediate Level Upon review of this report, the CFA approved the modification 
of the test bench and the proposed procedures for repair by the Aircraft Intermediate 
Maintenance Departments (AlMDs) at Naval Air Stations Barbers Point, Hawaii, and 
Brunswick, Maine. [Ref 19 and 20] 

■Analysis : Initial review of maintenance data (see Figure 5.1) before and after the NTR 
was submitted did not reveal a trend of reduced equipment failures or reduced maintenance 
manhours at either the O- or I-level activities. Failures remained at an average of 3.3 per 
month (Figure 5,2), 0-level maintenance manhours averaged 33.4 per month, while the 
number of I-level maintenance manhours remained at zero until repair actions started in June, 
1994 (Figure 5.3). The number ofBCMs averaged 1.25 per month even after AIMD 
Barbers Point received conditional approval for full repair capability. Total repair costs 





remained relatively constant throughout the period of interest (Figure 5.4). Based upon the 
maintenance data, the author could show no appreciable cost savings which could be 
attributed to the NTR. 

Continuing investigation through the Commander, Patrol Wings, Pacific logistics 
office provided further insight into the results of this NTR. The author interviewed Mr Jack 
Cargal [Ref 21], who related how the Aviation Supply Office (ASO) item manager shipped 
54 failed items to AIMD Barbers Point for repair and return to stock. This was done outside 
the normal maintenance documentation procedures, so would not be shown upon 
maintenance data reports. With this in mind, the author calculated the savings from this single 
action, AIMD had saved the Department of the Nat'y over $67,000 in the first year alone by 
avoiding depot repair costs of $1,252 per unit. The author interviewed Mr. Chuck Terlizzi 
[Ref 22], the item manager at ASO, who stated the average demand, which relates directly 
to the failure rate, of the item was forecasted as seven per quarter. With this information, the 
author calculated the cost savings until the year 2002 (see Figures 5.5 and 5.6), 

Based upon the full information concerning this item, the cost savings attributable to 
the maintenance level change amounts to over $67,000 annually from a modification that only 
co.st $400 














Figure 5 I-level versus D-level Repair Costs 















Figure 5.6 NTR Serial Number 9388/02 Repair Cost /Kralysis Data 
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NTR SERIAL NUMBER 8672/15 


Repon Date 26 January 1987 

Author Duane P Healy 

Activity : NAESU Detachment Jacksonville, Florida 

Discussion. The battery absorber used in the H-3 aircraft is designed to counteract 
the five per revolution vibrations caused by the main rotor blades When parts get worn or 
when the battery absorber is improperly adjusted, it will accentuate these vibrations A 
sudden rash of vibration problems revealed the link assemblies, part number S6120-61002-6, 
are being received from supply in an unusable condition It appears the bearings are being 
pressed into the link improperly, causing bearing pre-load and subsequent binding action in 
the beanngs This report requested the CFA review the manufacturing specifications with the 
contractor to ensure link assemblies were being produced. Subsequent investigation by the 
CFA revealed the need for a spacer to be inserted between the bearings, thus preventing pre- 
loading of the inner races when the bearings are pressed into the bracket of the link assembly 
[Refs. 23 and 24] 

■Analysis : Initial review of maintenance data (see Figure 5.7) before and after the NTR 
was submitted revealed a trend of reduced equipment failures and reduced maintenance 
manhours at the 0-level activities (Figures 5 8 and 5.9) I-level maintenance manhours are 
not included in this analysis, as the item is not an I-level repairable. Failures remained at an 
average of 2 6 per month through July and then dropped off to nearly zero. 0-level 
maintenance manhours followed the same trend, dropping off during May. Total cost data 
shows a downward trend. Due to the low unit cost of the item, the cost savings is not 
dramatic (Figure 5.10). Based upon the maintenance data, the author determined only minor 
cost savings which could be attributed to improved reliability and maintainability from the 




5 7 NTR Serial Number 8672/15 Maintenance Data 
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C. NTR SERIAL NUMBER 8629/09 

Report Date 29 August 1988 

Author : Toney Herlevic 

Activity : NAESU Detachment Miramar, California 

Discussion : The APS-125 radar system in the E-2C aircraft provides a one mega 

watt transmit pulse to the APA-17I antenna system through a series of connected rigid coax 
transmission lines. One section of this line, designation W85, differs from the other sections 
in that it is adjustable Failure to follow directions for proper installation of the rigid coax 
lines could result in damage and subsequent degradation of the radar and eventual total 
shutdown of the system This report recommended the CFA insert a caution in the 
maintenance publication to prevent the damage found The CFA agreed with the 
recommendation and submitted a manual change request to incorporate the suggested 
solution into the appropriate maintenance manual [Refs. 25 and 26] 
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Analysis : Initial review of maintenance data (see Figure 5 11) before and after the 
\TR was submitted did not reveal a trend of reduced equipment failures or reduced 
maintenance manhours at the O- or 1-level activities (Figures 5 12 and 5.13) Total cost data 
shows no significant trend (Figure 5 14) Based upon the maintenance data, the author could 
not attribute any improvements in reliability or maintainability, nor any related cost savings 
to the NTR 
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Figure 5 13 NTR Serial Number 8629/09 Maintenance Manhour Data 
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D. NTR SERIAL NUMBER 9124/02 


Repon Date 16 June 1987 

Author : Leonard A. Kress 

Activity . NAESU Detachment Jacksonville, Florida 

Discussion : Numerous manhours had been expended troubleshooting defective 

.APS-115 azimuth and tilt servo amplifiers on the P-3 aircraft. Many suspected bad parts were 
changed with no positive results Investigation revealed that in all of the defective servo 
amplifiers, the T-1 transformer, part number 43871, had been replaced Closer examination 
revealed internal connections in the replacement transformers were reversed during 
manufacture, resulting in no output and overheating. The report recommended reversal of 
the external connections and re-labeling output pins to correspond with the internal wiring 
change, and that steps be taken to ensure the transformers for the given part number be 
correctly manufactured in the future. [Refs. 27 and 28] 
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Analysis : Initial review of maintenance data (see Figure 5.15) before and after the 
NTR was submitted did not reveal a trend of reduced equipment failures or reduced 
maintenance manhours at 1-level activities (Figures 5.16 and 5.17). 0-level maintenance 
manhours are not included in this analysis, as the item is an I-level repairable. Total cost data 
shows no significant trend (Figure 5 18). Based upon the maintenance data, the author 
concluded there were no cost savings which could be attributed to improved reliability and 
maintainability from the NTR 

E. NTR SERIAL NUMBER 8821/06 


Repon Date . 11 December 1989 
.Author John W. Lammers 

Activity : NAESU Detachment Miramar, California 

Discussion . The flight control backup module pressure operated priority valve, part 
number A51H9214-3, can be installed backwards in the combined hydraulic system of the 
F-14 aircraft The hydraulic system will appear to function normally, yet the emergency flight 
control backup module will operate in a degraded mode with fluid bypass and system over¬ 
temperature discrepancies C mtinued operation under these conditions could cause loss of 
aircrew and aircraft. The report strongly recommended the CFA: 1) issue a one-time 
inspection of all F-14 aircraft for proper installation; 2) ensure the graphics in the 
maintenance manual clearly indicates proper installation orientation, and 3) direct the aircraft 
intermediate maintenance department and supply ensure the data plate showing the direction 
of fluid flow is affixed to the valve The CFA responded by issuing an airframes bulletin to 
all F-14 aircraft activities directing them to perform a one-time inspection to identify and 
correct the installation of the valves as necessary. [Refs. 29 and 30] 

■Analysis Initial review of maintenance data (see Figure 5.19) before and after the 
NTR was submitted did not reveal any trends. Available data showed a minimal number of 





repair actions at either the O- or I-level maintenance activities. Based upon the maintenance 
data, the author concluded there were no cost savings which could be attributed to improved 
reliability and maintainability from the NTR, 
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Figure 5 18 NTR Serial Number 9124/02 Repair Cost Data 


F. NTR SERIAL NUMBER 7986/09 

Report Date : 22 September 1987 
Author Thomas R, Montgomery 

Activity NAESU Detachment North Island, California 

Discussion : The sonobuoy gate actuator, part number DL1020M259, used on the 

H-3 aircraft was previously repaired at the depot level only. The source, maintenance and 
recoverability code was subsequently changed to allow I-level maintenance activities to 
perform maintenance on this item. It was estimated that a 90 percent RFI rate would be 
realized from this action. Unfortunately, the technical publications that outline repair 
procedures were not provided to the intermediate maintenance activities. The report 
recommended the CFA provide necessary publications for the item. [Refs 31 and 32] 
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Analysis Initial review of maintenance data (see Figure 5.20) before and after the 
NTR was submitted did not reveal a trend of reduced equipment failures or reduced 
maintenance manhours at either the 0- or I-level activities. Failures remained at an average 
of 8 8 per month (Figure 5 21), 0-level maintenance manhours averaged 30 per month, while 
the number of I-level maintenance manhours averaged 37 4 per month(Figure 5 22) The 
number of BCMs averaged 2 3 per month Total repair costs remained relatively constant 
throughout the period of interest (Figure 5 23). Based upon the maintenance data, the author 
could show no appreciable cost savings which could be attributed to improved reliability or 
maintainability from the NTR 
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Figure 5.22 NTR Serial Number 7986/09 Maintenance Manhour Data 
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\ I. SUMMARY. CONCLUSIONS AND RECOMMENDATIONS 


The objectives of this thesis were to 

• Describe the process by which techreps provide inputs for improvements to 
maintenance procedures, and modifications to aircraft weapons systems 

• Examine the NAESU Technical Report Record and Retrieval System data base to 
extract detailed information on those NAESU technical reports which relate to 
aircraft weapons systems and to identify problems associated with gathering 
meaningful information from the data base 

• Examine data bases available for extracting reliability and maintainability 
information concerning aircraft weapons systems and to identify problems 
associated with gathering meaningful information from these data bases 

• Determine the cost savings from improvements in reliability and maintainability of 
a sampling of NAESU technical repons for aircraft weapons systems 

• Refine the methodology for analyzing NAESU technical repons for determination 
of their contribution to cost savings in the Naval Aviation community 

To achieve the objectives of this thesis, six NTRs were selected for analysis Each 
NTR selected resulted in a CFA approved maintenance procedure/publication change 
Chapter I provided the nature of the Federal Government agency performance issue and the 
motivation for NAESU performance measures research Chapter I also provided thesis 
objectives, the primary thesis question, scope, literature review and organization for study 
Chapter II oriented the reader to specific background information concerning NAESU and 
Engineering Technical Services Chapter 11 further described the reporting and processing 
of NTRs through the CFA as well as an introduction to measures of performance used in this 
thesis Chapter III detailed the data collection process Included in Chapter III is the process 
used to locate NTRs and their respective feedback reports as well as maintenance data. 
Chapter 1\ detailed the methodology used by the author in selecting candidates for study and 
a model for conducting research 
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Chapter V presented the data collected from each NTR including specific background 
information and an analysis of related maintenance data relating to each NTR to determine 
Its effect on the reliability and maintainability of the item, and a determination of its cost 
savings Based upon the analysis, the author concluded NTRs can be used as a measure of 
performance Use of the research model can determine whether or not the NTR has provided 
a tangible cost savings through improvements in reliability and maintainability of an aircraft 
weapons system, 

A. CONCLUSIONS 


From the results of the analysis conducted in Chapter V, the author concluded the 
following 

• NTR Serial Number 9388/02 realizes a cost savings through improved 
maintainability of the equipment. Changing the maintenance level from the D-level 
to the 1-level has saved significant amounts of financial resources and will continue 
to do so throughout the lifetime of the item, 

• NTR Serial Number 8672/15 realizes minor cost savings through improved 
reliability and maintainability. From maintenance data, both failure rate and 
maintenance manhours show a downward trend which relate to cost savings 
throughout the lifetime of this item 

• NTR Serial Number 8629/09 has not contributed any improvements in reliability 
or maintainability, nor any related cost savings from available maintenance data 

• NTR Serial Number 9124/02 has not contributed any improvements in reliability 
or maintainability, nor any related cost savings from available maintenance data. 

• NTR Serial Number 8821/06 has not contributed any improvements in reliability 
or maintainability, nor any related cost savings from available maintenance data 

• NTR Serial Number 7986/09 has not contributed any improvements in reliability 
or maintainability, nor any related cost savings from available maintenance data 
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Clearly the issue of how to measure the performance ofNAESU is a complex process 
Determining improvements in the reliability and maintainability of equipment and associated 
cost savings from NTRs is quite difficult. Complicating this process is the difficulty in 
obtaining detailed maintenance data concerning the aircraft weapon's system addressed in 
each MR Because this thesis only examines a sample of NTRs, assuming no other changes 
have been incorporated on the aircraft weapons system, the reader is cautioned against 
interpreting the results of this study as wholly conclusive In fact, the limitations on this study 
presented in Chapter 1 preclude this. Rather, it shows a model for undertaking the task of 
determining whether or not the NTR has provided a tangible cost savings through 
improvements in reliability and maintainability of an aircraft weapons system 

B. RECOMMENDATIONS 

The following recommendations are offered by the author as a result of this thesis 
effort First, pursue the methodology used in this thesis in order to examine different NTRs 
in terms of historical actions which can then be used to support the measures of performance 
used in this thesis Periods of interest should be expanded a minimum of five years beyond 
the date of the NTR so as to include any major change initiated by the NTR. Labor costs and 
material costs for repair at all three levels of maintenance can pale against those incurred from 
a major change. This methodology can be expanded to cost savings associated with ECPs 
as the author discussed previously Projected improvements in reliability and maintainability 
are readily available from program managers when changes are approved. 

Second, consideration must be given to developing a software program which can be 
used to easily discern reliability, maintainability and cost data from the maintenance data 
collection system. This would be most beneficial to management at all levels to determine 
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what is occurring at fleet maintenance activities. With this information, researchers would 
hav e the tools to analyze maintenance actions and evaluate the validity of the maintenance 
concept 

Third, a comparison between the Navy's Engineering Technical Services program and 
civilian industry field service representatives might be done to determine what performance 
measures they use to determine the value of techreps 

Founh, the author recommends NAESU contact the Fleet Technical Support Center 
(FTSC), Norfolk. VA FTSC has contracted out the task of compiling technical reports on 
CD ROM This will make access to lessons learned about shipboard weapon's systems 
maintenance more convenient to all activities confronted with problems which may have 
already been discussed in technical reports. NAESU could easily negotiate with FTSC for 
inclusion on this program 

Finally, the author recommends that a minimum of three Naval Postgraduate School 
computer center employees be educated and trained in the NALDA system The NALDA 
data base is the primary source for logistics information for aircraft maintenance activities. 
The lack of the student's access to or familiarity with NALDA, the funding and time 
constraints involved in travel by students to NALDA sites (NADEPs, Naval Air Stations, and 
the Naval Aviation Maintenance Office) for thesis research, and the premium on the time 
others who currently use NALDA, impair the ability of students who must acquire and use 
the data now, and in their future assignments as professional logisticians 
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APPENDIX B. SAMPLE NAESU TECHNICAL REPORTS INDEX 













APPENDIX C. ABBREVIATIONS AND ACRONN MS 


The following is a list of abbreviations and acronyms as they are used in this thesis: 


ACC 

ACG 

ACT ORG 

AJMD 

APMl, 

ASO 

AT 

BCM 

BL'NO 

GETS 

CFA 

CFS 

CFSC 

CFSP 

CIP 

CPS 

DOD 

ECA 

ECP 

El 

EMT 

ETS 

FTSC 

GS 

HMR 


Aircraft Controlling Custodian 
.Airborne Coordinating Group 
Action Organization 

Aircraft Intermediate Maintenance Department 
Assistant Program Manager for Logistics 
Aviation Supply Office 
Action Taken 

Beyond Capability of Maintenance 
Bureau Number 

Contractor Engineering Technical Services 
Cognizant Field Activity 
Contractor Field Service 
Contractor Field Service, Competitive 
Contractor Field Service, Prime 
Component Improvement Program 
Contractor Plant Services 
Depanment of Defense 
Equipment Condition Analysis 
Engineering Change Proposal 
Engineering Investigation 
Elapsed Maintenance Time 
Engineering and Technical Services 
Fleet Technical Support Center 
General Schedule 
Hazardous Material Report 
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ILS 

ISE/RCM 

MAL 

MC 

MFG 

N-tL 

NADEP 

M.AESU 

NALDA 

NAMDRP 

NAVAIR 

NBR 

NCTS 

NTTS 

NMTS 

NSD 

NTR 

0MB 

PI 

QDR 

TEC 

TECHREP 

TM 

TPDR 

TYCOM 

\ AMOSC 

UT) 

WUC 


Integrated Logistics Support 

In-Service/Reliability Centered Maintenance 

Malfunction 

Meter Code 

Manufacturer 

Maintenance Level 

Naval Aviation Depot 

Naval Aviation Engineering Service Unit 

Naval Aviation Logistics Data Analysis 

Naval Aviation Maintenance Discrepancy Reporting Program 

Naval Air Systems Command 

Number 

Navy Civilian Technical Specialists 
Navy Engineering Technical Service 
Navy Military Technical Specialists 
Navy Support Date 
NAESU Technical Repon 
Office of Management and Budget 
Position Indicator 
Quality Deficiency Report 
Type Equipment Code 
Technical Representative 
Type Maintenance 

Technical Publication Deficiency Report 
Type Commander 

Visibility and Management of Operations and Support Cost 
When Discovered 
Work Unit Code 
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